Minimax estimation in multi-task regression under low-rank structures
نویسندگان
چکیده
This study investigates the minimaxity of a multi-task nonparametric regression problem. We formulate simultaneous function estimation problem based on information pooling across multiple experiments under low-dimensional structure. A reduced rank estimator nuclear norm penalisation scheme is proposed to incorporate structure in process. set functions defined terms their Fourier coefficients formally characterise dependence among functions. Minimax upper and lower bounds are established various asymptotic scenarios examine role low-rank determining optimal rates convergence. The results confirm that exploiting can significantly improve convergence rate for also imply minimax sense rank-constraint Sobolev class vector-valued
منابع مشابه
Minimax Multi-Task Learning
A multi-task learning (MTL) algorithm learns an inductive bias to learn several tasks together. MTL is incredibly pervasive in machine learning: it has natural connections to random effects models [5]; user preference prediction (including collaborative filtering) can be framed as MTL [6]; multi-class classification admits the popular one-vs-all and all-pairs MTL reductions; and MTL admits prov...
متن کاملEncoding Low-Rank and Sparse Structures Simultaneously in Multi-task Learning
Multi-task learning (MTL) aims to improve the performance of each task by borrowing the knowledge learned from other related tasks. Identifying the underlying structures among tasks is crucial for MTL to understand the relationship among tasks. In this paper, we propose a novel multi-task learning model to simultaneously consider low-rank structure and sparse structure. Combining these two type...
متن کاملLow rank Multivariate regression
We consider in this paper the multivariate regression problem, when the target regression matrix A is close to a low rank matrix. Our primary interest is in on the practical case where the variance of the noise is unknown. Our main contribution is to propose in this setting a criterion to select among a family of low rank estimators and prove a non-asymptotic oracle inequality for the resulting...
متن کاملMinimax regression estimation for Poisson coprocess
For a Poisson point process X , Itô’s famous chaos expansion implies that every square integrable regression function r with covariate X can be decomposed as a sum of multiple stochastic integrals called chaos. In this paper, we consider the case where r can be decomposed as a sum of δ chaos. In the spirit of Cadre and Truquet (2015), we introduce a semiparametric estimate of r based on i.i.d. ...
متن کاملMinimax Linear Regression under Measurement Constraints
We consider the problem of linear regression under measurement constraints and derive computationally feasible subsampling strategies to sample a small portion of design (data) points in a linear regression model y = Xβ + ε. The derived subsampling algorithms are minimax optimal for estimating the regression coefficients β under the fixed design setting, up to a small (1 + ) relative factor. Ex...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Nonparametric Statistics
سال: 2022
ISSN: ['1029-0311', '1026-7654', '1048-5252']
DOI: https://doi.org/10.1080/10485252.2022.2146110